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Abstract: 

English Learners, students who are not proficient in English and speak a non-English language at 
home, make up more than 10 percent of the nation’s K-12 student body. Achieving proficiency 
in English for these students is a major goal of both state and federal education policy, 
motivating the provision of bilingual education policies. Using data for nearly 500,000 English 
Learners from California, I show that students in bilingual education have substantially lower 
English proficiency than other English Learners in first and second grades. In contrast, there is 
little difference between bilingual education and other programs for students in grades three 
through five. These results hold across fixed effects, propensity score, and instrumental 
variables models. 
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Introduction 



Over 10 percent of the nation’s K-12 students are not proficient in English and speak a 
language other than English at home (Padolsky, 2005). In California, these students - called 
English Eearners - make up more than 25 percent of the K-12 student body. Although 
California has by far the most English Eearner (EE) students of any state in the country, many 
other states are experiencing rapid growth in the population of EE students. Eor example, the EE 
population has more than doubled in Colorado, Nevada, and Oregon over the last ten years, 
resulting in a student population that is more than ten percent EE in each state. Therefore, an 
analysis of the experience of EE programs in California can provide guidance for other states. 

The academic and labor-market success of EE students depends in large part on their 
ability to become proficient in English. Standardized tests are usually given in English, and EE 
students have consistently lower test scores than students whose native language is English. 
English language proficiency is critical for overall academic success. Eurthermore, several 
authors have demonstrated the positive link between English proficiency and success in the labor 
market (Gonzalez, 2000; Trejo, 2003; Bleakley and Chin, 2004). 

As most educators and researchers would agree, instruction targeting English proficiency 
is necessary for students with little English proficiency. Eor these students, the key research 
question concerns the most effective type of instructional services that they receive rather than 
whether or not they should receive services at all. Eor each student, the California data contain 
four categories for English language instruction (collectively referred to as EE services): (1) 
English Eanguage Development (EED), (2) EED and Specially Designed Academic Instruction 
Delivered in English (SDAIE), (3) EED and SDAIE with primary language support, and (4) EED 
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and academic subjects through primary language.* The last category is defined as “bilingual 
education” due to the use of primary language in academic subjects.^ For all these programs, 
academic instruction focuses on teaching the academic material, with the acknowledgment that 
the students have limited English proficiency. Bilingual programs address this issue by 
providing part or all of the instruction in the primary language. Other EL programs address this 
issue by providing additional explanation of terms, using pictures to add context, and in some 
cases providing small amounts of clarification in the primary language. In principle, the overall 
techniques are similar across programs. There are two important differences between bilingual 
programs and other EL programs. The first is the obvious difference in the language of 
instruction: bilingual programs teach academic subjects in the primary language, whereas other 
EL programs teach these subjects in English. The second difference is that bilingual programs 
attempt to improve primary language skills in addition to English language skills, whereas other 
EL programs focus only on improving English language skills. There is much debate over the 
role of native language instruction, yet much of this debate is based on belief rather than on 
empirical evidence (Greene, 1998). 

Whereas previous work on bilingual education has focused on academic achievement 
(Lopez, 2003; Gordon and Hoxby, 2002; Greene, 1998), the goal of this paper is to look at the 
effect of bilingual education on English proficiency. To that end, I use administrative data on 
almost 500,000 Spanish-speaking EL students in California to compare English Learners who 
receive bilingual education (academic instruction in the primary language) with English Learners 
who receive EL services that provide academic instruction in English. In California, students are 

* There is a fifth category for “other” EL services, treated as non-bilingual education, which contains few students. 

^ The bilingual education category includes all types of bilingual programs such as early-exit programs as well as 
dual-immersion programs. 

^ Matsudaira (2005) looks at the effects of receiving any instructional services, regardless of the language of 
instruction, on academic achievement. 
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not randomly assigned to bilingual programs. Schools choose whether to offer bilingual 
education, and students need to obtain parental permission in order to participate in bilingual 
programs, both consequences of 1998’s Proposition 227. I use multiple techniques to control for 
this non-random selection. In particular, I use propensity score analysis to match bilingual 
students with students receiving other EL services, based on the likelihood of participating in 
bilingual education. I also estimate instrumental variables (IV) models, using changes in 
bilingual availability around Proposition 227 as instruments for bilingual education."^ 

The results of this study show that bilingual education has a sizable negative effect on 
English proficiency for students in first and second grades, with magnitudes often in excess of 
0.3 standard deviations. This pattern is consistent across three different methods: OLS, matching 
estimators, and IV. In later elementary grades (3-5), the effect of bilingual education is usually 
less than 0.1 standard deviations, and it is sometimes not significantly different from zero. This 
negative effect is not surprising. Non-bilingual programs are narrowly focused on English 
proficiency, whereas bilingual education programs encourage proficiency in the student’s native 
language and in English. The pattern of results is also consistent with common approaches to 
dual-immersion bilingual education, where the percentage of instruction in English is as low as 
ten percent in kindergarten compared to nearly 50 percent by fifth grade. 

Relation to Previous Work 

Many researchers have written about bilingual education, but most of these studies are 
not able to identify the causal effect of bilingual education as opposed to other EL programs on 
student outcomes (Greene, 1998). Some of the studies lack a comparison group (i.e. students not 
in bilingual programs), whereas others do not control for observable (or unobservable) 

This approach is similar in spirit to the IV model used in Gordon and Hoxby (2002) in their analysis of bilingual 
education and academic achievement. 
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differences between students in bilingual programs and other students. In this paper, the 
discussion is limited to rigorous analyses that attempt to control for the non-random selection of 
students into bilingual education. 

Among the studies with comparison groups and controls for selection, several authors 
focus on the effects of primary language instruction, usually in academic subjects, on individual 
students. This restrictive definition is quite similar to the definition of bilingual education that I 
employ. Federman (2000), Lopez (2003), Lopez and Mora (1998), and Mora (2000) find 
insignificant or negative effects of bilingual programs on labor-market outcomes such as 
educational attainment and earnings (using a combination of methods, including propensity score 
and IV estimation).^ In contrast, Cheng (1996) finds positive IV effects of bilingual education 
on both these outcomes, although the exogeneity of his instruments is questionable. A limitation 
of these studies is that their comparison groups include all students who speak a language other 
than English at home.^ The comparison groups include students who are proficient in English as 
well as students who are not proficient in English. 

California’s mandated study of Proposition 227 finds insignificant effects of bilingual 
education on student-level mathematics and reading test scores (Parrish et ah, 2006). Their 
preferred model is a hierarchical linear model for a large panel of student-level data from the Eos 
Angeles school district. However, they acknowledge that this model may not fully control for 
the non-random selection of students into bilingual education programs. 

Gordon and Hoxby (2002) look at the effect of bilingual education (again defined as 
academic instruction in the primary language) on grade-level academic achievement in 
California. In their preferred IV model, they find a positive effect of bilingual education on 

^ These studies use National Educational Longitudinal Survey and High School and Beyond data. 

® The comparison group is chosen because the authors cannot identify English Learner status but they can identify 
language minority status. 
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achievement in multiple subjects, although these effects are concentrated in the earlier grades. 
They look separately at the effects of bilingual education on the performance of EL students as 
well as on the performance of English-proficient students. 

Greene (1998) conducts a meta-analysis of 11 rigorous studies on bilingual education. 

He finds a positive effect of bilingual education on academic achievement (primarily reading). 

In other words, students in bilingual education programs outperform other EL students, students 
who receive EL services in English or who receive no EL services. August and Shanahan (2006) 
provide a more recent meta-analysis and reach similar conclusions. Genesee et al. (2006) 
summarize the education literature and find positive associations between native-language 
instruction and various measures of English proficiency and academic achievement. 

Rather than looking at bilingual education, Matsudaira (2005) includes all English 
Language services in a single category. He uses a regression-discontinuity design and finds 
negligible differences in mathematics and reading achievement between students who receive 
English Language services and students who receive no such services. 

In sum, these studies find mixed effects of bilingual education on academic achievement 
and labor-market outcomes. They use a host of techniques to control for the nonrandom 
placement of students into bilingual education. Their data sets are either aggregated to the grade 
level or contain English proficient students along with English Learners. However, none of them 
considers the effect of bilingual education on English proficiency (as distinct from academic 
achievement in English, reading, or writing). 

Data 

In 2001, California implemented a statewide assessment, the California English 
Language Development Test (CELDT), to measure proficiency in English. The CELDT is 
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administered to all EL students in the fall of each school year. The CELDT consists of three 
portions: listening and speaking, reading, and writing. The listening and speaking portion is 
administered individually to students in all grades, where the tester asks each student a set of 
questions to measure both specific and general skills (Legislative Analyst’s Office, 2004). The 
reading and writing portions of the test, administered to students in grades 2 through 12, are 
standardized tests with multiple-choice and short- answer sections. An overall scale score is 
calculated based on the scale scores for each individual portion. 

The CELDT data contain extensive student level test score data on English proficiency, 
but they contain no measures of academic achievement. Scale scores are available for each 
portion of the English proficiency test (listening and speaking, reading, and writing), as well as 
for the overall score. These scores are available for the current school year as well as the 
previous school year. Comparisons of CELDT scores are only valid within each grade span (K- 
2, 3-5, 6-8, and 9-12). In other words, a scale score of 500 in grade one or two may or may not 
represent the same level of English proficiency as a scale score of 500 in grade four or five. 
Consequently, separate regressions are estimated for each grade and year. 

As mentioned above, the CELDT data identify the type of EL services provided. In 
addition, CELDT demographic data contain information on primary language, gender, age, 
mobility, and program participation (for programs other than EL). The mobility information 
includes the number of years in the current school and the number of years in U.S. schools. The 
non-EL programs include special education receipt and Title I receipt (i.e. supplemental services, 
typically targeting low-income students). 



^ Data prior to 2004 also contain information on the years in the current district. The data on years in U.S. schools 
are quite noisy, so I do not use them in the analysis. 
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Student-level CELDT data are supplemented with school-level data from the California 
Basic Education Data System (CBEDS). These data include school-level information on 
teachers (because researchers cannot link EE students to their individual teachers), school 
demographics, and academic achievement (for non-EE students) in mathematics. 

The CEEDT data are a repeated cross section rather than a panel. They contain the 
previous year’s CEEDT score (in addition to the current year’s CEEDT score), but all other data 
is from the current school year. The bilingual education variable is from the current year, which 
I treat as a proxy for bilingual education in the previous year. Eor a subset of students, I was able 
to merge CEEDT data across years using the school identifier, birth date, grade, and gender. Eor 
these students, most had the same EE program for both years. Eurthermore, the regression 
results were qualitatively similar when using the previous year’s EE program rather than current 
year’s EE program. I use data from the current year because the sample is much larger and more 
representative, and the results are not sensitive to this choice. 

There are a few sample restrictions in the data. Students in their first year in a California 
school have not been exposed to any EE program and therefore are excluded from the sample. 
Students who skipped a grade or repeated a grade are also excluded. Because 99 percent of 
students in bilingual programs in California are native Spanish speakers, I only include native 
Spanish speakers in the analysis sample. One or two percent of EE students attend charter 
schools, and they are excluded from the analysis. Similarly, students in nontraditional schools 
such as alternative schools, special education schools, and county offices of education also are 
excluded. Einally, less than one percent of the students have invalid values of either test scores 
or grade spans, so they are excluded from the sample. 

Descriptive Characteristics 
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Table 1 presents the descriptive statistics for the analysis sample. The statistics are 
separated by year (2003 and 2004), as well as by grade (one through five). The average test 
score is usually between 450 and 550 for the current year, with a standard deviation between 50 
and 65. The percentage of students in bilingual education programs is highest for students in 
first and second grades, with a percentage of 13 to 14 percent. The percentage is around nine 
percent for fourth-grade students and six percent for fifth-grade students. These small 
percentages are to be expected given the provision of Proposition 227 that students be taught 
“overwhelmingly” in English. Roughly 80 percent are eligible for Title I services, and between 
four percent (first grade) and 1 1 percent (fifth grade) receive special education services. The 
average student attends a school that has little language diversity, and the majority of students in 
the school are English Eearners. 

Participation in Bilingual Education 

This section takes a closer look at the relationship between bilingual education 
participation and student and school characteristics. In California, the participation decision for 
bilingual education is a two-part process. The first step for a student to participate in bilingual 
education is for the student to attend a school that offers bilingual education, as schools are not 
required to offer bilingual education. If the student attends a school that offers bilingual 
education, the student may participate in bilingual education if at least one parent visits the 
school and signs a permission slip. Thus, the placement of students into bilingual programs is a 
subjective process by the schools - whether to offer bilingual education - and by the parents - 
whether to enroll their children in bilingual education. I focus on the outcome of this process: 
whether or not the student participates in bilingual education. 
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Table 2 contains the marginal effects from a probit on bilingual participation, presented 
in percentage terms. The marginal effects are calculated at the mean for continuous variables; 
for dichotomous variables, the marginal effect is the change in probability of bilingual 

o 

participation from changing the dichotomous variable from zero to one. Recall that bilingual 
participation is largest in the younger grades - around 14 percent in first grade - and smallest in 
the oldest grades - around six percent in fifth grade. Participation in bilingual education is 
negatively associated with previous CELDT scores in reading/listening and writing, but the 
association is positive for reading scores. For first-grade students, a one-standard deviation 
increase in the previous listening and speaking score (about 90 points - see Table 1) is associated 
with a decreased likelihood of participation in bilingual education of about four percentage 
points- approximately one-third of the mean participation rate. The effect is similar for second- 
grade students. When measured as a percentage of the bilingual participation rate, the effect of 
previous test scores is sizable, ranging from 27 to 57 percent. 

Other student characteristics have significant differences in bilingual education 
participation. Females generally have slightly higher participation. Students receiving special 
education services correspond to noticeably lower participation in bilingual education. On the 
other hand, students who have spent more time in their current school correspond with somewhat 
higher participation. 

Selected school characteristics have significant relationships with bilingual education. 

The percentage of EF students in the school has a large, positive relationship with bilingual 
education participation. Similarly, the language homogeneity index - higher for schools with 
little diversity in the home language of EF students - also has a large and positive relationship. 
Perhaps the positive coefficients on these two variables reflect economics of scale - more 

* Although not reported, results from a linear probability model are quite similar. 
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bilingual education in schools with higher concentrations of students speaking the same non- 
English language. For grades one through three, schools with higher California Standards Test 
(CST) scores - a test of academic achievement in English and Eanguage Arts - correspond with 
modestly lower participation. 

OLS Model and Results 

The pattern of results from the participation probit suggests that students in bilingual 
programs differ from students in other instructional programs along many dimensions. In order 
to control for these differences, the starting point for the analysis is an ordinary least squares 
(OES) regression, as shown in equation (1): 

( 1 ) ENGPROF. = BILNGUAL.a + X.p + £.. 

In this equation, ENGPROF i is student z’s scale score from the current school year of the CEEDT 
(2003 or 2004). Recall that I estimate separate models for each year and for each grade. 

Because students in kindergarten and first grade only take the listening/speaking portion of the 
test, the only outcome variable for the grades one and two is the listening/speaking scale score. 
For grades three through five, separate models are estimated for each of the three portions: 
listening/speaking, reading, and writing. 

BILINGUALi is a dummy variable for whether or not the student receives academic 
instruction in the student’s native language (Spanish, as the sample is limited to Spanish- 
speakers). In other words, the comparison group contains EE students who do not receive 
academic instruction in their native language. 

Xi can be partitioned into three components (and a constant term), LAGPROFi (lagged 
English proficiency), STUDENTi, and SCHOOLu LAGPROFi contains the scale scores from the 
previous year’s CEEDT. Again, for grades one and two, LAGPROFi has only one test score, the 
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previous year’s listening/speaking portion. For grades three through five, LAGPROFi contains 
three test scores, one for each portion of the test. This structure allows for a more 
comprehensive effect of lagged English proficiency. 

STUDENTi is a vector of student-level characteristics such as sex, special education 
receipt, and participation in the Title I program (a proxy for family income), as listed in Tables 1 
and 2. SCHOOLi is a vector of school-level characteristics from the previous school year.^ 

The OLS results are in Table 3. The top panel contains the results for the listening and 
speaking test. The middle panel contains the results for the reading test, and the bottom panel 
contains the results for the writing test. Each table contains a separate column for each grade and 
year. Eor each test and grade, the first column is from 2003 and the second column is from 2004. 
Appendix Tables la through Ic contain the results for the covariates other than bilingual 
education. 

Bilingual education has a negative coefficient for the listening and speaking test, 
although the coefficient is much larger for grades one and two. Specifically, the effect is above 
0.4 standard deviations for grade one and is above 0.2 standard deviations for grade two. In 
contrast, the coefficient is 0.05 standard deviations in grades three and four, and the coefficient 
for grade five is not statistically different from zero at the five-percent level. In other words, the 
negative association between bilingual education and listening/speaking proficiency is 
concentrated in first and second grades; by third grade, the effect is extremely small. 

The coefficients for bilingual education in the reading proficiency regressions vary by 
grade. In third grade, bilingual education is associated with a small, positive effect of 0.06 to 

^ Because the CELDT is administered toward the beginning of the school year, most of the value added since the last 
administration of the CELDT occurred in the previous school year. Eor example, the 2004 CELDT contains school 
characteristics from the 2003-2004 school year. There is an implicit assumption that students attended their current 
school in the previous school year. The results are similar if I use current school year characteristics instead. 
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0.08 standard deviations. In fourth and five grades, the results vary by year. This pattern of 
results suggests that bilingual education does not have a strong association - either positive or 
negative - with reading test scores. 

The bottom panel of Table illustrates that bilingual education has a modest, negative 
association with writing proficiency. The coefficient is negative and significant in all years and 
grades. In third grade, bilingual education is associated with a 0. 10 or 0. 1 1 decrease in writing 
proficiency. For fourth grade the effect size is a 0.06 to 0.08 standard-deviation decrease, and in 
fifth grade the effect size is a 0.06 standard-deviation decrease. 

Bilingual education is not the only determinant of English proficiency, as illustrated by 
the results in Appendix Tables la through Ic. As expected, previous test scores have strong 
positive effects: Students do not lose English proficiency from one year to the next. Eemales 
and students who have spent more time in their current school have higher test scores, whereas 
disadvantaged students - Title I students and students receiving special education services - have 
lower test scores. 

At the school level, average test scores (of non-EE students) in English/Eanguage Arts 
also are positively associated with English proficiency. The school’s percentage of EE students 
is associated with lower listening and speaking proficiency. The percent of teachers who are 
fully credentialed has a positive association with reading proficiency and writing proficiency. 
Other school characteristics, including the access to teachers specifically authorized to teach EE 
students, do not consistent effects on English proficiency. 

Table 4 contains the results from a school fixed-effects estimator. This model controls 
for between-school differences in fixed (observable and unobservable) factors. Rossell (2005) 
illustrates how California schools had great variation in defining bilingual education and other 
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EL instructional programs. In other words, two schools may offer the same program, but one 
school calls it bilingual education and one school calls it something else. Rather than identifying 
the bilingual education effects off of such situations, the school fixed-effects model is identified 
only off of within-school differences in bilingual education. The results are similar to the OLS 
results in Table 3, although the magnitudes of the effect may vary slightly. These findings 
suggest that between-school variation in bilingual education programs is not driving the OLS 
results. 

Propensity Score Models and Results 

In this section, propensity score analysis provides a robustness check on the OLS results 
in Table 3. Lor bilingual education, the propensity score equals the likelihood of participating in 
bilingual education, calculated as the predicted probability from the probit equation of bilingual 
education receipt reported in Table 2. The propensity scores obtained from a logit model are 
nearly identical. The independent variables are defined as in equation (1).'° 

Ligure 1 illustrates the predicted propensity scores for Lall 2004, separately by grade. As 
expected, propensity scores are higher for students who participate in bilingual education than 
for those who do not. The area of common support is 100 percent for both cohorts (and for 
2003, although not shown in the figure). Both of these factors are consistent with a valid 
propensity score estimator, but the validity of the estimator ultimately hinges on the assumption 
that observables capture all relevant determinants of bilingual education participation. 

Propensity scores dominate the matching literature. However, there are many types of 
propensity score estimators, and no single estimator dominates the literature (see, for example. 

Researchers often use interaction terms or higher-ordered terms (for continuous independent variables) in order to 
improve the goodness-of-fit of the probit (or logit) generating the propensity score. However, there is no theoretical 
basis for including these extra terms. Their goal is to eliminate any statistically significant differences in variables 
between the treatment and control groups. However, given the size of my sample, it is extremely difficult to 
eliminate all statistically significant differences between students in bilingual education and other EL students. 
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Frolich, 2004). Because the focus of the paper is on the effectiveness of bilingual education, not 

propensity score estimators, I employ three common methods: kernel density, nearest neighbor, 

and caliper. Essentially, the kernel density estimator creates a weighted average of the 

comparison group (in this case, EL students not in bilingual education) for each student in the 

treatment group (in this case, EL students in bilingual education).*^ 

In the nearest-neighbor approach, each student in bilingual education is matched with the 

four students in other EL programs who have the most similar propensity scores. I choose four 

because simulation results in Abadie and Imbens (2006) worked best - in terms of mean- squared 

error - for four neighbors, although my results for four are quite similar to results with other 

1 ^ 

numbers of matches (from 1 to 5). 

The third method is a caliper or radius method. I match each student in bilingual 
programs with all students in other EL programs who have a propensity score with a given 
amount, called the radius. I choose a radius of 0.000004 (which produces a similar average 
number of matches to the four nearest neighbors), although results with radii of 0.000001 to 
0.000005 produce nearly identical results. 

Table 5 contains the results from all three types of propensity score estimators. The 
reported results are simple differences in means between the two groups, the full set of students 
in bilingual education and the matched set of EL students in other programs. These differences 
are reported in terms of standard deviations of the dependent variable (current test score). 
Regression-adjusted estimates are similar to the simple averages, and therefore are not reported. 

" I use a matching program in Stata called psmatch2 (see Leuven and Sianesi, 2003) to calculate the propensity 
score estimators. For a recent review of matching estimators, with an application to job training programs, see 
Mueser, Troske, and Gorislavsky (2007) and the references cited there. 

I use the default options in psmatch2; an Epanechnikov kernel (as recommended by Silverman, 1986) with a 
bandwidth of 0.08. 

I match with replacement, and I include ties (i.e. students with identical propensity scores), even if including them 
raises the number of closest neighbors above four. The results are not sensitive to either of these assumptions. 
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The results do not account for the variation resulting from the matching process. Given the 
similarity of the results to the OLS results for the full sample, it is extremely doubtful that 
controlling for that variation will substantially alter the findings. Furthermore, Abadie and 
Imbens (2006) show that bootstrapping the standard errors is not necessarily appropriate. 

The estimators in Table 5 are quite similar to the OLS estimators (measured in standard 
deviation effects) for the full sample (Table 3). With one exception, the full sample OLS 
standard-deviation effect lies between the three matching estimators. For example, the full 
sample OLS coefficient is -0.48 standard deviations for first-grade students (Table 3a, column 1). 
This coefficient falls between the kernel density estimate of -0.5 1 and the radius/caliper estimate 
of -0.43 (both from Table 5, column 1). There are several potential explanations for the 
similarity between matching estimators and OLS coefficients. The area of common support is 
100 percent for the kernel and nearest neighbor matching, but falls to roughly 60 to 80 percent 
for radius matching. This high percentage suggests that propensity score samples may be 
similar, but not identical, to the overall sample (controlling for observables). A related 
explanation is that selection on observables is largely linear. In this case, OLS models control 
for selection and therefore the propensity score - a nonlinear function of observables - provides 
little additional information. 

A third explanation is that the matching procedure based on the propensity score is not 
appropriate. Propensity scores are convenient because they reduce the matching problem to one 
variable, the propensity score. Matching across multiple variables - i.e. directly on the 
observables (or a subset of them) rather than on a nonlinear function of them - is difficult to 
implement successfully (Smith and Todd, 2005). For example, Mueser, Troske, and Gorislavsky 
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(2007) and Frolich (2004) find that Mahalanobis distance methods perform worse than 
propensity score methods. Therefore, I do not pursue multi-dimensional matching estimators. 



Instrumental Variables Models and Results 

One concern with the OLS and matching estimators is that the bilingual education 
coefficient may be picking up the effect of other variables that cannot be measured. For 
example, suppose that bilingual education students receive much more parental participation 
(such as parent-teacher conferences, help with homework, etc.) than students in other EL 
programs. Because the data do not contain measures of parental involvement, OLS and 
matching estimators may be confounding the effect of bilingual education and parental 
involvement. 

The results in this section use an instrumental variables (IV) approach to address this 
concern. I consider two sets of instruments. The first set of instruments are measures of changes 
in bilingual education participation as a result of the 1998 state proposition severely restricting 
access to bilingual education. The second and alternate set of instruments is the percentage of 
voters who voted for the proposition limiting bilingual education. Passed in the summer of 1998, 
Proposition 227 required that EL students be taught “overwhelmingly” in English, and it created 
barriers to providing bilingual education (most notably the requirement that each student in 
bilingual education obtain parental permission). As expected, the percentage of EL students in 
bilingual education dropped sharply after 1998.^^ 



Similarly, Frolich (2004) finds that using the odds ratio of the propensity score, as suggested by Imbens (2000), 
performed more poorly than directly using propensity score methods. 

In order to make sure that the instrument is not identified from schools that dropped bilingual programs after 
Proposition 227, 1 estimate additional models that exclude schools where no EL students are in bilingual education 
programs (as well as schools where all EL students are in bilingual programs). The results from these models are 
nearly identical to the results from the models reported in this section. 
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Gordon and Hoxby (2002) also use an instrument based on Proposition 227 in their 
analysis of bilingual education and academic achievement. Their instrument is the change in the 
percent of students eligible for bilingual education services if schools strictly adopted 
Proposition 227. In other words, they set the percentage of students eligible for bilingual 
education to zero for the post-Proposition 227 period. For the pre-Proposition 227 period, the 
percentage is the percentage of EL students (calculated separately for each grade and school). 
They also assume that bilingual education is not offered for grades with fewer than 10 EL 
students because expired federal and California laws set the threshold for offering bilingual 
education at 10 students.*^ 

Part of the appeal of this instrument is that it relies solely on the exogenous “shock” to 
bilingual education resulting from Proposition 227. However, this instrument is highly 
correlated with the percentage of students classified as EL students, one of the school level 
variables in equation (1). In fact, using Gordon and Hoxby ’s (2002) instrument always produces 
insignificant first-stage coefficients; therefore, it is not used. 

Instead, I use two related, school-level instruments for the first set of instruments. The 
first is the mechanical change in the percentage of EL students participating in bilingual 
education as a result of Proposition 227. As in Gordon and Hoxby (2002), the mechanical 
percentage is set to zero for the post-Proposition period. The pre-Proposition measure is the 
school-level percentage of students enrolled in bilingual education in spring 1998 (i.e. right 
before Proposition 227). Because the post-Proposition percentage is set to zero, the 

This threshold has no effect on bilingual education participation in the 2003 and 2004 CELDT data. Other 
thresholds, such as 5 or 15, also have no effect. Therefore, thresholds are not used in the definition of the 
instruments in this paper. 

The school is chosen as the level of analysis in order to reduce the influence of measurement error based on 
within-school changes in either bilingual enrollment or total enrollment. When the instrument is defined at the 
grade level (as in Gordon and Hoxby, 2002), the instrument is insignificant in the first-stage regression (predicting 
bilingual participation). 
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mechanical change (i.e. post-Proposition minus pre-Proposition) is equal to the opposite of the 
pre-Proposition percentage. This percentage has a strong, negative effect on the first-stage 
regressions, i.e. linear probability models on the likelihood of participating in a bilingual 
program. First-stage results are contained in Appendix Table 2. 

In order for this instrument to be valid, it must not be directly correlated with student- 
level English proficiency. Because the post-Proposition 227 percentage is set to zero, the 
instrument depends entirely on the percentage of students enrolled in bilingual programs in 
spring 1998. The outcome is a student-level measure of English proficiency. Very few if any of 
the English Eearners in grades K-5 in 2003 or 2004 were in school before Proposition 227, 
therefore minimizing the possibility that these students were directly affected by Proposition 
227. Still, it is possible that this percentage is related to unobserved school characteristics that 
affect English proficiency. 

I also use a second instrument that uses changes over time in the school-level percent 
bilingual. Rather than measuring the mechanical change in percent bilingual, this additional 
instrument measures the actual change in percent bilingual between spring 1998 and spring 1999 
(at the school level). Any school- specific attributes that are constant between 1998 and 1999 
would not be captured by this instrument. However, changes in school attributes as a result of 
Proposition 227 would be captured by the instrument. This instrument is positive and highly 
significant in the first-stage regression (participation in bilingual education). 

The IV results for these two instruments are in Table 6. The table reports the full model, 
where each cell is from a separate IV model. The layout is the same as Table 4 (the results for 
the school fixed effect model). The first two columns are for grade one, the second two for grade 
two, and so on. Within each grade, the first column is for 2003 and the second is for 2004. The 
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dependent variable is the English listening/speaking proficiency in the top panel, the English 
reading proficiency in the middle panel, and the English writing proficiency in the bottom panel. 

Bilingual education has a large, negative association with listening and speaking 
proficiency in first and second grade. The IV coefficients show no evidence of a negative effect 
for listening and speaking proficiency in grades three through five, as the coefficients are always 
positive and in some cases statistically significant. Eor reading proficiency, bilingual education 
has a positive association with bilingual education for students in grades three and four, and the 
coefficients for grade five are not statistically different from zero. Eor writing proficiency, 
bilingual education has a modest, negative association for grades three and four, and the 
coefficient for grade five varies across years. 

As mentioned previously, I also consider a second IV strategy that uses the voting 
behavior on Proposition 227. Specifically, I match each Census block to the nearest elementary 
school, and then calculate the percentage of “yes” votes on Proposition 227. Presumably, 
schools with more support for Proposition 227 are less likely to offer bilingual education than 
schools with less support for the Proposition. Indeed, the first stage results in Appendix Table 3 
are consistent with this hypothesis. Eor this instrument to be valid, however, I assume that 
voting behavior in 1998 is not directly correlated with student-level English proficiency in 2003 
and 2004. However, I have no way to test this assumption directly. 

The results from this IV analysis are in Table 7. In other words, the instrument in Table 7 
is the percentage of voters who voted “yes” for Proposition 227. The other two instruments 
mentioned previously are excluded in order to provide an alternate identification strategy based 
on voting data rather than on education data. The IV results from the voting data (Table 7) are 
similar in spirit to earlier tables, but they are less precisely estimated. The large, negative 

** I thank Eric Brunner for sharing data and programs allowing me to link voting data with school data. 
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coefficients in grades 1 and 2 are still evident, but the results for later grades are very noisy. For 
example, the bilingual coefficients on the fifth-grade listening and speaking test are above 50, 
but the standard errors are in excess of 20. The imprecise estimates in Table 7 are not surprising 
because the instrument is not perfect: school attendance boundaries and Census block boundaries 
overlap. Still, the pattern of results is consistent with the other IV estimates. 

In sum, the results are generally consistent across all three methods (OLS, propensity 
score, and IV). Compared to other EL programs, bilingual education has a sizable, negative 
association with English listening/speaking proficiency for EL students in first and second grade. 
Eor EL students in grades three through five, bilingual education has a small and often 
insignificant association with English proficiency. 

Bilingual Education by Previous Proficiency Score 

As seen above, EL students in bilingual education have dramatically lower English 
listening and speaking proficiency than EL students in other EL programs in first and second 
grades. Bilingual education has small and often insignificant associations with English 
proficiency for students in grades three through five. These findings are robust across years and 
across estimation methods. This section contains an exploration of whether bilingual education 
has differential effects based on students’ prior English proficiency levels. 

Specifically, I estimate an OLS model similar to equation (1), except for the addition of 
variables interacting the bilingual education variable with dummy variables for each quartile of 
the previous year’s listening and speaking score. The results for the listening and speaking test 
are in Table 8, and results for reading and writing are in Appendix Table 4. 



The results are similar when the quartile interactions terms are replaced with a single interaction term between 
bilingual education and the previous year’s listening and speaking test score. 
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The results for all three English proficiency test show the same pattern: the bilingual 
education coefficient improves dramatically with the quartile of lagged listening and speaking 
proficiency. In other words, the students who appear to benefit the most from bilingual 
education relative to other EL programs are the students who had strong English 
listening/speaking proficiency in the previous year. Eor students in the lowest quartile, bilingual 
education is associated with lower listening and speaking test scores of more than 40 points 
(approximately 0.6 standard deviations) among first-grade students. Eor students in the third- 
lowest quartile, the bilingual coefficient is only -11 points in 2003 and -7 points in 2004.). Other 
grade levels also have a positive relationship between lagged listening and speaking proficiency 
and the bilingual coefficient, although the range of effects is much smaller. 

Attrition 

One concern with the results in all the tables is the relationship between student attrition 
and bilingual education. By using lagged CELDT scores, the sample is restricted to students 
who took the CELDT in the current year and in the previous year. If attrition from one year to 
the next is systematically related to bilingual education status, then the estimates in the table are 
not valid. There are two sources of attrition in the CELDT data. Eirst, attrition occurs if a 
student leaves the California public school system (CELDT test score data are available for 
students who switch public schools within California). Second, attrition occurs if a student is no 
longer considered an English Learner. Once a student is considered proficient in English, that 
student no longer is considered an English Learner and stops taking the CELDT. 

Because the data are a repeated cross-section, I cannot directly measure attrition. Instead, 
I calculate attrition indirectly by attempting to merge the fall 2003 cross-section with the fall 
2004 cross-section. Student identifiers are not available, so I match students based on school. 
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grade, gender, and birth date. Therefore, I limit the attrition analysis to students in the fall 2003 
cross-section who can be uniquely identified based on the matching variables (school, grade, 
gender, and birth date). I focus on kindergarten through fourth grade because these students 
would be in grades one through five in the fall 2004 cohort. Table 9 contains the percentage of 
students who were successfully matched in the fall 2004 cohort. The top panel combines all 
students, whereas the bottom two panels provide separate information by bilingual status. 

The table shows that substantial attrition occurs: 65 percent of students in the fall 2003 
cohort are in the fall 2004 cohort. Students in bilingual programs have lower attrition than 
students in other EL programs, although the difference declines as the grade increases. The 
results are similar for each quartile of the 2003 listening and speaking test. This pattern of 
results is not consistent with the hypothesis that the large, negative bilingual education 
coefficients in grades K-2 and small, often insignificant, bilingual coefficients in grades 3-5 
occurs because the high-achieving, non-bilingual students in grades 3-5 were more likely to 
become proficient in English. On the other hand, the lower attrition for students in bilingual 
programs is not consistent with the hypothesis that the bilingual education coefficients are biased 
down because bilingual education students are economically disadvantaged and therefore more 
likely to leave California schools. Thus, the table suggests that the results in this paper are not 
being driven by systematic attrition of EL students. 

Discussion 

This paper studies the causal effect of bilingual education versus other EL programs on 
English proficiency. The comparison group is the set of students receiving other EL programs 
because most educators and policymakers agree that these EL students need some sort of EL 

Note that the quartile is calculated for all students in the appropriate grade level. Separate quartiles are not 
calculated for students in bilingual programs and for students in other EL programs. 
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program. Not offering them any EL program is no more plausible an option than not offering 
them a mathematics program. The study uses a unique administrative data set of California EL 
students in elementary grades. Students are not randomly assigned to bilingual education: In 
California, Proposition 227 (1998) requires parental permission slips before students are allowed 
in bilingual education classrooms. I use two approaches to control for this selection: propensity 
score analysis, which controls for selection on observables, and instrumental variables, where the 
instruments are based on the abrupt change in bilingual education availability caused by 
Proposition 227. 

The results from both selection techniques are similar to the OLS results. In grades one 
and two, students in bilingual education program have lower listening and speaking proficiency 
scores than other EL students. The size of this effect is large - over 0.3 standard deviations in 
many cases. Eurthermore, the effect of bilingual education is inversely related to students’ 
previous listening and speaking proficiency. Students with low English listening and speaking 
proficiency in the previous year have particularly large, negative effects of bilingual education, 
whereas students with higher levels of English proficiency suffer little if any negative 
consequences of bilingual education. Policymakers should consider this adverse effect on 
English listening and speaking when evaluating bilingual education programs, as they represent a 
cost to the youngest and weakest students. 

Eor students in grades three through five, the effects of bilingual education versus other 
EL programs are much smaller. In several cases, the effects on English proficiency are 
insignificant or even positive. In terms of standard deviations, nearly all of the effects are under 
0.1 standard deviations, and many are under 0.05 standard deviations. Although these effects are 
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sometimes statistically significant, their small size suggests fewer concerns about the negative 
consequences of bilingual education on English proficiency for older students. 

Why would bilingual education have a large, negative effect of English listening and 
speaking proficiency for students in early elementary grades but smaller (and sometimes 
insignificant) effects in later grades? Bilingual programs in kindergarten and first grade use 
native language much more extensively than English; some sources suggest only 10 percent of 
the instruction provided by dual-immersion programs is in English (Ovando and Collier, 1998). 
By fourth or fifth grade, the language split is roughly equal between English and Spanish. If this 
90/10 model (as it is known) is common in California, then lower English proficiency gains 
might be expected for bilingual education students in first and second grades, as compared to 
other EE programs where a higher proportion of overall instruction takes place in English. 

Because student-level academic achievement data are not available, this paper looks at 
only one outcome: English proficiency as measured by the CEEDT data. Bilingual education 
has many goals, including overall academic proficiency. Still, English proficiency in the 
younger grades is essential for overall academic achievement. Although bilingual education is 
not as successful as other EE programs for early elementary school students, it may have other 
benefits that are not captured in the administrative data used here. Previous work finds mixed 
effects for academic achievement (for example, Eopez, 2003; Gordon and Hoxby, 2002). 

Eurther research on all relevant outcomes (not just English proficiency and academic 
achievement) is needed. 
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Table 1 - Descriptive Statistics by Grade and Year 



Grade 1 Grade 2 Grade 3 Grade 4 Grade 5 





2003 


2004 


2003 


2004 


2003 


2004 


2003 


2004 


2003 


2004 


Current CELDT Scale Scores 






















Listening/Speaking 


500.7 


497.3 


537.0 


537.2 


505.1 


504.5 


530.4 


533.1 


546.1 


551.2 




(59.0) 


(58.4) 


(58.8) 


(56.9) 


(57.3) 


(54.9) 


(61.3) 


(59.6) 


(64.0) 


(62.7) 


Reading 










469.7 


471.6 


497.1 


497.3 


514.8 


516.5 












(49.2) 


(49.5) 


(49.4) 


(49.7) 


(50.4) 


(50.7) 


Writing 










491.9 


497.2 


514.3 


517.4 


526.4 


530.3 












(53.2) 


(54.2) 


(49.8) 


(51.1) 


(48.9) 


(50.2) 


Lagged CELDT Scale Scores 






















Listening/Speaking 


413.7 


409.2 


482.8 


493.7 


511.9 


529.5 


490.5 


494.7 


504.4 


515.8 




(88.4) 


(93.6) 


(65.7) 


(70.2) 


(68.2) 


(71.5) 


(69.6) 


(68.5) 


(75.2) 


(74.8) 


Reading 










443.2 


445.7 


461.8 


463.3 


485.3 


486.5 












(47.3) 


(46.6) 


(48.3) 


(50.1) 


(50.2) 


(51.5) 


Writing 










460.1 


465.0 


474.2 


483.4 


494.6 


502.2 












(59.6) 


(59.4) 


(59.0) 


(59.9) 


(58.6) 


(59.8) 


Bilingual Education 


0.135 


0.141 


0.134 


0.138 


0.122 


0.122 


0.091 


0.092 


0.060 


0.061 




(0.341) 


(0.348) 


(0.341) 


(0.345) 


(0.327) 


(0.328) 


(0.287) 


(0.289) 


(0.238) 


(0.239) 


Student Demographics 






















Female 


0.490 


0.488 


0.492 


0.492 


0.492 


0.492 


0.490 


0.488 


0.484 


0.481 




(0.500) 


(0.500) 


(0.500) 


(0.500) 


(0.500) 


(0.500) 


(0.500) 


(0.500) 


(0.500) 


(0.500) 


Title I 


0.817 


0.776 


0.830 


0.792 


0.843 


0.804 


0.850 


0.824 


0.861 


0.836 




(0.386) 


(0.417) 


(0.376) 


(0.406) 


(0.364) 


(0.397) 


(0.357) 


(0.381) 


(0.346) 


(0.371) 


Special education 


0.041 


0.047 


0.056 


0.065 


0.074 


0.079 


0.088 


0.098 


0.103 


0.113 




(0.199) 


(0.211) 


(0.230) 


(0.246) 


(0.262) 


(0.270) 


(0.283) 


(0.298) 


(0.304) 


(0.316) 


Years in current school 


1.872 


1.883 


2.629 


2.641 


3.290 


3.288 


3.803 


3.808 


4.234 


4.227 




(0.361) 


(0.342) 


(0.701) 


(0.657) 


(1.070) 


(1.045) 


(1.464) 


(1.460) 


(1.862) 


(1.841) 



28 




Table 1 (Continued) - Descriptive Statistics by Grade and Year 



Grade 1 



Grade 2 Grade 3 



Grade 4 Grade 5 



School Demographics 


2003 


2004 


2003 


2004 


2003 


2004 


2003 


2004 


2003 


2004 


Language homogeneity index 


0.861 


0.860 


0.863 


0.866 


0.865 


0.865 


0.865 


0.866 


0.862 


0.868 




(0.179) 


(0.179) 


(0.177) 


(0.176) 


(0.176) 


(0.176) 


(0.177) 


(0.176) 


(0.179) 


(0.176) 


Class size 


19.15 


19.53 


19.14 


19.48 


19.14 


19.52 


18.79 


19.17 


18.33 


18.72 




(1.33) 


(1.87) 


(1.34) 


(1.92) 


(1.45) 


(1.93) 


(2.93) 


(3.21) 


(4.05) 


(4.29) 


Percent EL 


57.44 


55.13 


57.45 


56.21 


57.98 


55.89 


57.52 


55.97 


56.97 


55.82 




(22.60) 


(21.86) 


(22.25) 


(21.85) 


(22.20) 


(21.76) 


(22.22) 


(21.72) 


(22.15) 


(21.56) 


Average teacher experience 


10.78 


11.60 


10.79 


11.58 


10.79 


11.61 


10.78 


11.55 


10.80 


11.55 




(2.81) 


(2.98) 


(2.78) 


(2.93) 


(2.78) 


(2.93) 


(2.78) 


(2.91) 


(2.81) 


(2.94) 


Percent BA or less 


27.31 


23.54 


27.29 


24.22 


27.68 


24.44 


27.96 


25.03 


27.51 


25.31 




(19.13) 


(18.52) 


(19.11) 


(18.36) 


(19.04) 


(18.48) 


(19.07) 


(18.44) 


(19.00) 


(18.57) 


Percent BA + 30 


45.89 


48.78 


45.99 


47.76 


45.69 


47.33 


45.35 


46.99 


45.63 


46.72 




(20.73) 


(21.19) 


(20.97) 


(21.02) 


(20.52) 


(21.02) 


(20.37) 


(20.59) 


(20.49) 


(20.50) 


Percent fully credentialled 


87.22 


91.55 


87.35 


91.34 


87.13 


91.27 


86.96 


91.00 


87.10 


90.77 




(12.40) 


(10.12) 


(12.06) 


(9.90) 


(12.14) 


(9.95) 


(12.15) 


(10.03) 


(12.01) 


(10.30) 


EL teacher access 


0.09 


0.09 


0.09 


0.09 


0.08 


0.09 


0.08 


0.09 


0.08 


0.09 




(0.10) 


(0.10) 


(0.11) 


(0.10) 


(0.09) 


(0.12) 


(0.09) 


(0.10) 


(0.08) 


(0.09) 


Percent new students 


16.80 


17.82 


17.05 


18.00 


17.00 


18.31 


16.85 


18.27 


17.24 


18.30 




(8.29) 


(9.38) 


(8.39) 


(9.43) 


(8.41) 


(10.26) 


(8.08) 


(10.34) 


(8.69) 


(10.39) 


Average CST score 


327.3 


320.4 


328.5 


322.6 


328.9 


323.5 


329.3 


324.7 


329.2 


325.3 




(35.6) 


(62.2) 


(26.3) 


(56.6) 


(23.6) 


(54.1) 


(23.1) 


(51.3) 


(22.9) 


(49.5) 


Observations 


114,259 


110,349 


121,637 


119,368 


115,188 


120,396 


112,624 


109,983 


100,010 


101,376 



Note: Standard deviations are in parentheses. 
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Table 2 - Probit Marginal Effects for Bilingual Education Participation by Grade and Year, As Percentages 



Grade 1 Grade 2 Grade 3 Grade 4 Grade 5 





2003 


2004 


2003 


2004 


2003 


2004 


2003 


2004 


2003 


2004 


Eagged listen/ 


-0.040 


-0.046 


-0.073 


-0.084 


-0.012 


-0.023 


-0.020 


-0.009 


-0.010 


-0.006 


speak 


(0.003) 


(0.003) 


(0.004) 


(0.004) 


(0.002) 


(0.003) 


(0.002) 


(0.003) 


(0.002) 


(0.002) 


Eagged reading 










-0.007 


-0.018 


0.029 


0.016 


0.016 


0.004 












(0.004) 


(0.004) 


(0.004) 


(0.003) 


(0.004) 


(0.003) 


Eagged writing 










-0.080 


-0.076 


-0.062 


-0.066 


-0.033 


-0.033 












(0.005) 


(0.005) 


(0.005) 


(0.005) 


(0.004) 


(0.004) 


Eemale 


0.07 


0.25 


-0.07 


0.45 


0.72 


0.89 


0.41 


0.56 


0.15 


0.45 




(0.19) 


(0.19) 


(0.18) 


(0.19) 


(0.17) 


(0.17) 


(0.15) 


(0.15) 


(0.13) 


(0.13) 


Title 1 


0.63 


-0.29 


0.57 


0.05 


-0.46 


-0.31 


-0.05 


2.13 


0.23 


1.88 




(1.26) 


(1.31) 


(1.19) 


(1.21) 


(1.27) 


(1.14) 


(1.01) 


(0.77) 


(0.82) 


(0.60) 


Special 


-2.35 


-1.93 


-3.09 


-3.41 


-5.25 


-4.83 


-3.41 


-4.03 


-2.31 


-2.30 


education 


(0.55) 


(0.57) 


(0.48) 


(0.46) 


(0.39) 


(0.36) 


(0.32) 


(0.34) 


(0.29) 


(0.27) 


Years in current 


1.66 


3.77 


2.54 


4.46 


2.30 


3.28 


1.50 


2.00 


0.48 


0.69 


school 


(1.00) 


(0.76) 


(0.51) 


(0.47) 


(0.31) 


(0.25) 


(0.20) 


(0.18) 


(0.11) 


(0.11) 


Eanguage index 


15.76 


12.59 


14.78 


11.68 


14.48 


12.39 


13.51 


8.76 


7.65 


4.35 




(3.88) 


(3.83) 


(3.51) 


(3.62) 


(3.32) 


(3.14) 


(2.78) 


(2.78) 


(2.13) 


(2.37) 


Class size 


-1.66 


-1.13 


-1.79 


-0.91 


-1.59 


-1.13 


-0.32 


-0.47 


-0.37 


-0.40 




(0.45) 


(0.35) 


(0.40) 


(0.35) 


(0.36) 


(0.28) 


(0.16) 


(0.12) 


(0.09) 


(0.08) 


Percent EE 


0.23 


0.28 


0.22 


0.23 


0.20 


0.18 


0.13 


0.10 


0.06 


0.06 




(0.03) 


(0.04) 


(0.03) 


(0.03) 


(0.03) 


(0.03) 


(0.02) 


(0.02) 


(0.02) 


(0.02) 


Average teacher 


-0.66 


2.17 


-0.40 


2.35 


0.12 


1.71 


0.12 


3.22 


-0.38 


1.86 


experience 


(0.93) 


(1.02) 


(0.89) 


(1.00) 


(0.89) 


(0.89) 


(0.81) 


(0.85) 


(0.70) 


(0.63) 


Percent BA or 


0.02 


0.09 


-0.04 


0.14 


-0.06 


0.09 


-0.03 


0.10 


-0.07 


0.10 


less 


(0.05) 


(0.05) 


(0.05) 


(0.05) 


(0.05) 


(0.04) 


(0.04) 


(0.04) 


(0.03) 


(0.03) 


Percent BA + 30 


0.08 


0.03 


0.02 


0.10 


0.01 


0.05 


0.01 


0.03 


-0.02 


0.03 




(0.03) 


(0.04) 


(0.03) 


(0.04) 


(0.03) 


(0.03) 


(0.03) 


(0.03) 


(0.02) 


(0.02) 


Percent fully 


0.12 


0.05 


0.12 


0.04 


0.11 


0.09 


0.15 


0.08 


0.11 


0.06 


credentialed 


(0.06) 


(0.08) 


(0.05) 


(0.07) 


(0.05) 


(0.06) 


(0.04) 


(0.05) 


(0.03) 


(0.04) 


EE teacher 


-10.85 


-8.09 


-12.18 


1.75 


-5.94 


1.08 


2.19 


4.22 


2.74 


3.39 


access 


(9.55) 


(8.17) 


(9.85) 


(4.23) 


(8.34) 


(2.52) 


(3.76) 


(1.85) 


(3.17) 


(2.20) 


Percent new 


-0.03 


0.03 


-0.13 


0.02 


-0.06 


0.02 


0.07 


0.02 


0.05 


0.04 


students 


(0.06) 


(0.05) 


(0.06) 


(0.05) 


(0.06) 


(0.04) 


(0.05) 


(0.04) 


(0.04) 


(0.03) 


Average GST 


-0.13 


-0.06 


-0.16 


-0.06 


-0.11 


-0.07 


-0.12 


-0.06 


-0.09 


-0.05 


score 


(0.05) 


(0.05) 


(0.04) 


(0.04) 


(0.04) 


(0.03) 


(0.03) 


(0.03) 


(0.03) 


(0.03) 


Observations 


114,259 


110,349 


121,637 


119,368 


115,188 


120,396 


112,624 


109,983 


100,010 


101,376 



Notes: Standard errors clustered by school are in parentheses. Each column contains results from a separate model. 
Each model also contains controls for age, grade, squared teacher experience, and dummy variables for missing 
variables. 
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Table 3 - OLS Results, by Grade and Year 



Grade 1 Grade 2 


Grade 3 


Grade 4 


Grade 5 


2003 2004 2003 2004 

Dependent Variable - Listening/Speaking Proficiency 


2003 


2004 


2003 


2004 


2003 


2004 


Bilingual education -28.60 -25.35 -18.15 -12.80 


-2.94 


-1.61 


-2.27 


-2.35 


-2.74 


-2.74 


(1.28) (1.42) (0.87) (0.90) 


(0.93) 


(0.82) 


(1.07) 


(0.92) 


(1.41) 


(1.51) 


[-0.48] [-0.43] [-0.31] [-0.22] 


[-0.05] 


[-0.03] 


[-0.04] 


[-0.04] 


[-0.04] 


[-0.04] 


Dependent Variable - Reading Proficiency 


Bilingual education 


3.15 


4.07 


-0.30 


1.25 


-2.45 


-1.06 




(0.60) 


(0.56) 


(0.60) 


(0.55) 


(0.83) 


(0.75) 


Dependent Variables - Writing Proficiency 


[0.06] 


[0.08] 


[-0.01] 


[0.03] 


[-0.05] 


[-0.02] 


Bilingual education 


-5.59 


-5.18 


-4.14 


-3.04 


-2.69 


-3.17 




(0.65) 


(0.65) 


(0.66) 


(0.62) 


(0.79) 


(0.85) 




[-0.11] 


[-0.10] 


[-0.08] 


[-0.06] 


[-0.06] 


[-0.06] 



Observations 114,259 110,349 121,637 119,368 115,188 120,396 112,624 109,983 100,010 101,376 

Notes: Standard errors clustered by school are in parentheses. The brackets measure the bilingual effect in standard deviations of the 
dependent variable. Unlike previous tables, each cell (coefficient, standard error, and standard-deviation effect) is from a separate 
regression. See the variables and notes to Appendix Tables la through Ic for a more complete list of additional control variables. 
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Table 4 - School Fixed Effect Models of English Proficiency, by Test, Grade, and Year 



Grade 1 Grade 2 Grade 3 Grade 4 Grade 5 



2003 


2004 2003 


2004 


2003 


2004 


2003 


2004 


2003 


2004 


Dependent Variable - Listening/Speaking Proficiency 














Bilingual education -26.10 


-25.59 -20.89 


-13.63 


-4.41 


-4.01 


-5.90 


-3.43 


-6.56 


-5.89 


(0.59) 


(0.59) (0.61) 


(0.57) 


(0.62) 


(0.55) 


(0.74) 


(0.69) 


(0.97) 


(0.90) 


[-0.44] 


[-0.44] [-0.36] 


[-0.24] 


[-0.08] 


[-0.07] 


[-0.10] 


[-0.06] 


[-0.10] 


[-0.09] 


Dependent Variable - Reading Proficiency 
















Bilingual education 






2.22 


3.20 


-1.46 


0.59 


-3.77 


-3.86 








(0.50) 


(0.48) 


(0.53) 


(0.52) 


(0.67) 


(0.64) 








[0.05] 


[0.06] 


[-0.03] 


[0.01] 


[-0.07] 


[-0.08] 


Dependent Variables - Writing Proficiency 
















Bilingual education 






-5.75 


-4.78 


-3.99 


-3.31 


-3.34 


-5.34 








(0.51) 


(0.49) 


(0.53) 


(0.54) 


(0.65) 


(0.64) 








[-0.11] 


[-0.09] 


[-0.08] 


[-0.06] 


[-0.07] 


[-0.11] 


Observations 1 14,259 


110,349 121,637 


119,368 


115,188 


120,396 


112,624 


109,983 


100,010 


101,376 



Notes: Standard errors clustered by school are in parentheses. The brackets measure the bilingual effect in standard deviations of the 
dependent variable. Each cell (coefficient, standard error, and standard-deviation effect) is from a separate regression. See the 
variables and notes to Appendix Tables la through Ic for a more complete list of additional control variables. 
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Table 5 - Propensity Score Estimators for Bilingual Education Effect, by Test, Grade, and Year 



Grade 1 



Grade 2 Grade 3 



Grade 4 Grade 5 





2003 


2004 


2003 


2004 


Dependent Variable 


- Listening/Speaking Proficiency 


Kernel density 


[-0.51]" 


[-0.48]” 


[-0.33]” 


[-0.27]' 


Eour nearest neighbors [-0.49]” 


[-0.47]” 


[-0.31]” 


[-0.26]' 


Radius <= 0.00004 


[-0.43]" 


[-0.39]” 


[-0.31]” 


[-0.18]' 



Dependent Variable - Reading Proficiency 
Kernel density 

Eour nearest neighbors 

Radius <= 0.00004 

Dependent Variables - Writing Proficiency 
Kernel density 

Eour nearest neighbors 

Radius <= 0.00004 



2003 


2004 


2003 


2004 


2003 


2004 


[-0.06]” 


[-0.06]” 


[-0.03]” 


[-0.07]” 


[-0.08]" 


[-0.09]' 


[-0.03]” 


[-0.03]” 


[-0.01] 


[-0.04]" 


[-0.05]" 


[-0.03] 


[-0.04]” 


[-0.02] 


[-0.04]” 


[-0.02] 


[-0.06]" 


[-0.08]' 


[0.04]” 


[0.04]” 


[-0.02]* 


[-0.01] 


[-0.10]" 


[-0.08]' 


[0.07]” 


[0.06]” 


[0.01] 


[0.02] 


[-0.06]" 


[-0.04]' 


[0.06]” 


[0.10]” 


[0.002] 


[0.10]” 


[-0.04]" 


[-0.01] 


[-0.12]” 


[-0.13]” 


[-0.09]” 


[-0.10]" 


[-0.10]" 


[-0.12]' 


[-0.09]” 


[-0.10]” 


[-0.05]” 


[-0.07]" 


[-0.07]" 


[-0.07]' 


[-0.12]” 


[-0.10]” 


[-0.09]” 


[-0.11]** 


[-0.06]" 


[-0.09]' 



Notes: The brackets measure the bilingual effect in standard deviations of the dependent variable. * denotes statistical significance at the 
five-percent level (two-sided test) and ** denotes statistical significance at the one -percent level (two-sided test). Simple standard errors 
(i.e. not bootstrapped) are calculated for calculating statistical significance. Each cell is from a separate propensity score estimator. 
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Table 6 - Instrumental Variables Models for English Proficiency, by Test, Grade, and Year 
Instruments are Measures of Proposition-227 Induced Changes in School-Level Bilingual Education Availability 



Grade 1 


Grade 2 


Grade 3 


Grade 4 


Grade 5 


2003 2004 


2003 


2004 


2003 


2004 


2003 


2004 


2003 


2004 


Dependent Variable - Listening/Speaking Proficiency 
















Bilingual education -43.99 -32.75 


-23.01 


-15.25 


2.19 


6.46 


2.24 


3.53 


2.12 


7.90 


(3.26) (2.83) 


(2.70) 


(2.04) 


(2.43) 


(2.33) 


(3.26) 


(3.13) 


(5.53) 


(5.30) 


[-0.75] [-0.56] 


[-0.39] 


[-0.27] 


[0.04] 


[0.12] 


[0.04] 


[0.06] 


[0.03] 


[0.13] 


Dependent Variable - Reading Proficiency 


















Bilingual education 






9.23 


9.94 


3.21 


4.55 


1.71 


0.91 








(1.51) 


(1.43) 


(1.61) 


(1.54) 


(2.34) 


(2.36) 








[0.19] 


[0.20] 


[0.07] 


[0.09] 


[0.03] 


[0.02] 


Dependent Variables - Writing Proficiency 


















Bilingual education 






-6.69 


-4.29 


-6.34 


-3.08 


-0.71 


5.59 








(1.60) 


(1.47) 


(1.66) 


(1.60) 


(2.34) 


(2.58) 








[-0.13] 


[-0.08] 


[-0.13] 


[-0.06] 


[-0.01] 


[0.11] 


Observations 114,259 110,349 


121,637 


119,368 


115,188 


120,396 


112,624 


109,983 


100,010 


101,376 



Notes: Standard errors clustered by school are in parentheses. The brackets measure the bilingual effect in standard deviations of the dependent 
variable. Each cell (coefficient, standard error, and standard-deviation effect) is from a separate regression. See the variables and notes to 
Appendix Tables la through Ic for a more complete list of additional control variables. 
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Table 7 - Instrumental Variables Models for English Proficiency, by Test, Grade, and Year 
Instrument is the Percentage of "Yes" Votes on Proposition 227 

Grade 1 Grade 2 Grade 3 Grade 4 Grade 5 



2003 2004 


2003 


2004 


2003 


2004 


2003 


2004 


2003 


2004 


Dependent Variable - Listening/Speaking Proficiency 
















Bilingual education -53.75 -33.66 


-25.37 


-16.65 


-12.34 


12.11 


0.36 


9.56 


51.96 


59.95 


(9.93) (8.81) 


(8.27) 


(6.82) 


(7.60) 


(6.85) 


(12.38) 


(10.07) 


(33.28) 


(23.92) 


[-0.91] [-0.58] 


[-0.43] 


[-0.29] 


[-0.22] 


[0.22] 


[0.01] 


[0.16] 


[0.81] 


[0.96] 


Dependent Variable - Reading Proficiency 


















Bilingual education 






5.54 


8.64 


-7.67 


2.24 


-22.11 


0.01 








(4.59) 


(3.92) 


(5.73) 


(5.10) 


(13.04) 


(9.46) 








[0.11] 


[0.17] 


[-0.16] 


[0.05] 


[-0.44] 


[<0.01] 


Dependent Variables - Writing Proficiency 


















Bilingual education 






-12.37 


-7.88 


-20.18 


-8.97 


-38.27 


-0.76 








(4.64) 


(4.12) 


(6.13) 


(5.61) 


(15.55) 


(10.70) 








[-0.23] 


[-0.15] 


[-0.41] 


[-0.18] 


[-0.78] 


[-0.02] 


Observations 111,167 107,579 


118,427 


116,101 


112,159 


117,152 


109,498 


106,841 


95,178 


96,528 



Notes: Standard errors clustered by school are in parentheses. The brackets measure the bilingual effect in standard deviations of the dependent 
variable. Each cell (coefficient, standard error, and standard-deviation effect) is from a separate regression. See the variables and notes to 
Appendix Tables la through Ic for a more complete list of additional control variables. 
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Table 8 - Bilingual Education Interacted with Previous Listening/Speaking Quartile, by Grade and Year 
Dependent V ariable - Listening and Speaking Proficiency 



Grade 1 



Grade 2 Grade 3 



Grade 4 Grade 5 







2003 


2004 


2003 


2004 


2003 


2004 


2003 


2004 


2003 


2004 


Bilingual 


* 1st quartile 


-42.78 


-43.72 


-28.55 


-24.89 


-15.19 


-9.72 


-11.75 


-8.49 


-11.07 


-8.88 






(2.01) 


(2.19) 


(1.11) 


(1.11) 


(1.19) 


(1.00) 


(1.27) 


(1.17) 


(1.62) 


(1.65) 


Bilingual 


* 2nd quartile 


-34.31 


-23.97 


-13.63 


-5.04 


2.88 


5.37 


2.13 


-0.62 


2.41 


1.24 






(1.46) 


(1.37) 


(0.94) 


(0.97) 


(1.01) 


(0.98) 


(1.31) 


(1.13) 


(1.77) 


(1.93) 


Bilingual 


* 3rd quartile 


-11.41 


-6.79 


-6.52 


0.47 


11.24 


10.33 


8.24 


5.23 


4.97 


3.57 






(1.21) 


(1.30) 


(1.17) 


(1.09) 


(1.33) 


(1.00) 


(1.64) 


(1.31) 


(2.22) 


(2.23) 


Bilingual 


* 4th quartile 


1.99 


4.36 


-3.70 


1.91 


10.92 


4.64 


9.63 


3.08 


3.79 


-3.08 






(1.47) 


(1.70) 


(1.66) 


(1.70) 


(1.61) 


(1.76) 


(1.98) 


(1.71) 


(3.16) 


(3.19) 


Observations 


114,259 


110,349 


121,637 


119,368 


115,188 


120,396 


112,624 


109,983 


100,010 


101,376 



Notes: Standard errors clustered by school are in parentheses. Each column is from a separate regression. See the variables and notes to 
Appendix Tables la through Ic for a more complete list of additional control variables. 
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Table 9 - Percentage of Students in Fall 2003 Cohort Who Are in Fall 2004 Cohort 
By EL Program, Grade, and Fall 2003 Listening/Speaking Quartile 



All Students 


KG to 4 


KG 


All Quartiles 


65.1% 


52.0% 


1 St Quartile 


55.2% 


41.6% 


2nd Quartile 


68.5% 


53.2% 


3rd Quartile 


71.7% 


55.8% 


4th Quartile 


65.0% 


56.5% 


Not Bilingual 


All Quartiles 


64.5% 


51.3% 


1 St Quartile 


53.4% 


40.0% 


2nd Quartile 


67.7% 


52.3% 


3rd Quartile 


71.5% 


55.2% 


4th Quartile 


64.8% 


56.1% 


Bilingual 


All Quartiles 


70.1% 


60.6% 


1 St Quartile 


65.0% 


54.4% 


2nd Quartile 


73.9% 


61.9% 


3rd Quartile 


74.5% 


65.5% 


4th Quartile 


69.1% 


65.3% 



Fall 2003 Grade 



1 


2 


3 


4 


69.9% 


70.5% 


66.9% 


64.6% 


64.2% 


67.3% 


64.5% 


65.6% 


72.5% 


73.7% 


72.3% 


71.7% 


72.8% 


73.3% 


71.8% 


66.7% 


70.3% 


69.1% 


61.8% 


57.1% 



69.2% 


70.0% 


66.5% 


64.7% 


61.5% 


66.0% 


63.8% 


66.0% 


71.9% 


73.2% 


72.1% 


72.0% 


72.3% 


72.8% 


71.7% 


66.8% 


69.9% 


68.7% 


61.4% 


57.2% 



74.9% 


74.4% 


70.3% 


63.5% 


71.9% 


71.6% 


68.1% 


63.1% 


77.4% 


76.3% 


74.5% 


69.3% 


78.9% 


78.1% 


73.3% 


65.8% 


76.5% 


76.1% 


67.1% 


55.6% 
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Figure 1 - Fall 2004 Propensity Scores by Grade and Bilingual Education Participation 



Grade 1 Grade 4 




Grade 2 Grade 5 




Grade 3 














Appendix Table la - OLS Results for Listening/Speaking Proficiency, by Grade and Year 



Grade 1 Grade 2 Grade 3 Grade 4 Grade 5 





2003 


2004 


2003 


2004 


2003 


2004 


2003 


2004 


2003 


2004 


Bilingual education 


-28.60 


-25.35 


-18.15 


-12.80 


-2.94 


-1.61 


-2.27 


-2.35 


-2.74 


-2.74 




(1.28) 


(1.42) 


(0.87) 


(0.90) 


(0.93) 


(0.82) 


(1.07) 


(0.92) 


(1.41) 


(1.51) 


Lagged listening/speaking 


0.300 


0.309 


0.395 


0.420 


0.220 


0.260 


0.224 


0.359 


0.189 


0.309 




(0.004) 


(0.004) 


(0.004) 


(0.005) 


(0.006) 


(0.004) 


(0.006) 


(0.005) 


(0.006) 


(0.004) 


Lagged reading 










0.227 


0.224 


0.272 


0.169 


0.268 


0.177 












(0.006) 


(0.005) 


(0.006) 


(0.005) 


(0.007) 


(0.006) 


Lagged writing 










0.181 


0.123 


0.159 


0.104 


0.186 


0.118 












(0.006) 


(0.005) 


(0.006) 


(0.005) 


(0.007) 


(0.006) 


Female 


0.738 


2.234 


1.745 


2.344 


1.583 


0.955 


3.265 


0.061 


3.161 


-0.753 




(0.302) 


(0.294) 


(0.299) 


(0.274) 


(0.296) 


(0.259) 


(0.318) 


(0.284) 


(0.360) 


(0.317) 


Title I 


-1.218 


-1.571 


-1.541 


-1.697 


-3.325 


-0.686 


-1.961 


-0.572 


-1.836 


-1.726 




(0.883) 


(0.823) 


(0.861) 


(0.750) 


(0.778) 


(0.788) 


(0.904) 


(0.813) 


(0.967) 


(0.858) 


Special education 


-24.13 


-26.63 


-18.70 


-20.58 


-17.86 


-17.50 


-11.79 


-14.26 


-9.64 


-10.51 




(0.956) 


(0.951) 


(0.726) 


(0.706) 


(0.607) 


(0.577) 


(0.615) 


(0.588) 


(0.691) 


(0.595) 


Years in current school 


4.872 


4.638 


2.016 


1.191 


0.851 


0.639 


0.983 


0.267 


0.913 


0.276 




(0.833) 


(0.753) 


(0.368) 


(0.296) 


(0.215) 


(0.182) 


(0.174) 


(0.146) 


(0.146) 


(0.119) 


Language index 


5.431 


0.561 


1.800 


0.044 


2.958 


1.486 


3.922 


0.887 


2.136 


-0.948 




(2.106) 


(1.811) 


(1.941) 


(1.797) 


(1.953) 


(1.668) 


(2.184) 


(1.807) 


(2.309) 


(2.174) 


Class size 


0.265 


0.347 


0.374 


-0.156 


-0.107 


-0.388 


-0.180 


0.014 


-0.395 


0.074 




(0.349) 


(0.236) 


(0.286) 


(0.267) 


(0.223) 


(0.177) 


(0.161) 


(0.131) 


(0.122) 


(0.088) 


Percent EL 


-0.194 


-0.207 


-0.128 


-0.134 


-0.130 


-0.126 


-0.110 


-0.108 


-0.064 


-0.129 




(0.022) 


(0.022) 


(0.020) 


(0.019) 


(0.018) 


(0.017) 


(0.021) 


(0.020) 


(0.023) 


(0.020) 


Avg teacher experience 


0.193 


-0.079 


-0.408 


-0.081 


0.311 


-0.330 


0.694 


0.432 


0.275 


-0.528 




(0.930) 


(0.593) 


(0.727) 


(0.509) 


(0.627) 


(0.523) 


(0.718) 


(0.586) 


(0.772) 


(0.633) 
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Appendix Table la (Continued) - OLS Results for Listening/Speaking Proficiency, by Grade and Year 





Grade 1 


Grade 2 


Grade 3 


Grade 


4 


Grade 5 




2003 


2004 


2003 


2004 


2003 


2004 


2003 


2004 


2003 


2004 


Percent BA or less 


-0.066 


-0.057 


-0.071 


0.069 


-0.039 


-0.017 


0.011 


0.029 


-0.049 


0.019 




(0.039) 


(0.034) 


(0.037) 


(0.028) 


(0.031) 


(0.029) 


(0.036) 


(0.030) 


(0.040) 


(0.032) 


Percent BA +30 


-0.074 


-0.072 


-0.047 


-0.027 


0.019 


-0.019 


0.038 


0.014 


-0.013 


-0.018 




(0.027) 


(0.024) 


(0.025) 


(0.019) 


(0.022) 


(0.020) 


(0.026) 


(0.022) 


(0.027) 


(0.025) 


Percent fully credentialed 


-0.002 


-0.027 


-0.031 


0.055 


-0.035 


-0.032 


-0.050 


0.006 


-0.018 


0.042 




(0.047) 


(0.058) 


(0.036) 


(0.049) 


(0.037) 


(0.044) 


(0.048) 


(0.051) 


(0.049) 


(0.052) 


EL teacher access 


5.424 


-0.259 


5.125 


-1.155 


0.818 


2.619 


4.710 


8.828 


10.338 


3.841 




(2.920) 


(2.701) 


(3.215) 


(2.453) 


(3.209) 


(2.050) 


(3.577) 


(2.379) 


(3.988) 


(3.079) 


Percent new students 


-0.024 


-0.169 


0.017 


-0.032 


-0.047 


-0.042 


-0.065 


-0.025 


0.050 


-0.031 




(0.052) 


(0.059) 


(0.042) 


(0.030) 


(0.043) 


(0.029) 


(0.051) 


(0.029) 


(0.055) 


(0.031) 


Average CST score 


0.137 


0.071 


0.139 


0.113 


0.113 


0.092 


0.099 


0.087 


0.150 


0.073 




(0.032) 


(0.030) 


(0.025) 


(0.022) 


(0.024) 


(0.022) 


(0.029) 


(0.024) 


(0.032) 


(0.028) 


Observations 


114,259 


110,349 


121,637 


119,368 


115,188 


120,396 


112,624 


109,983 


100,010 


101,376 



Notes: Standard errors clustered by school are in parentheses. The brackets measure the bilingual effect in standard deviations of the dependent variable. R- 
squareds range from 0.29 to 0.39. All models also contain controls for squared teacher experience, age, grade, and dummy variables for missing variables 
(except bilingual education). 



40 




Appendix Table lb - OLS Results for Reading Proficiency, by Grade and Year 

Grade 3 Grade 4 Grade 5 





2003 


2004 


2003 


2004 


2003 


2004 


Bilingual education 


3.15 


4.07 


-0.30 


1.25 


-2.45 


-1.06 




(0.60) 


(0.56) 


(0.60) 


(0.55) 


(0.83) 


(0.75) 


Lagged listen/speak 


0.025 


0.019 


0.021 


0.031 


0.026 


0.026 




(0.003) 


(0.002) 


(0.003) 


(0.003) 


(0.003) 


(0.003) 


Lagged reading 


0.406 


0.427 


0.457 


0.431 


0.470 


0.466 




(0.005) 


(0.004) 


(0.004) 


(0.004) 


(0.006) 


(0.005) 


Lagged writing 


0.214 


0.220 


0.194 


0.212 


0.160 


0.173 




(0.005) 


(0.005) 


(0.004) 


(0.004) 


(0.006) 


(0.005) 


Female 


3.319 


2.930 


5.600 


3.092 


5.865 


2.770 




(0.227) 


(0.217) 


(0.214) 


(0.220) 


(0.236) 


(0.231) 


Title I 


-1.621 


-1.737 


-1.835 


-1.421 


-1.230 


-0.777 




(0.517) 


(0.453) 


(0.496) 


(0.435) 


(0.508) 


(0.451) 


Special education 


-17.13 


-16.22 


-17.98 


-17.65 


-19.68 


-18.24 




(0.615) 


(0.526) 


(0.507) 


(0.479) 


(0.518) 


(0.472) 


Years in current schl 


-0.316 


-0.219 


-0.259 


-0.428 


-0.172 


-0.313 




(0.157) 


(0.142) 


(0.096) 


(0.090) 


(0.087) 


(0.076) 


Language index 


-0.972 


-2.269 


-1.071 


-2.896 


-2.594 


-2.219 




(1.210) 


(1.088) 


(1.071) 


(0.984) 


(1.010) 


(1.040) 


Class size 


-0.036 


-0.259 


0.036 


0.018 


0.096 


0.011 




(0.138) 


(0.113) 


(0.063) 


(0.058) 


(0.049) 


(0.047) 


Percent EL 


-0.019 


0.009 


0.012 


0.012 


0.021 


0.006 




(0.011) 


(0.010) 


(0.010) 


(0.010) 


(0.010) 


(0.010) 


Avg teacher exp 


-0.009 


0.189 


0.823 


0.419 


-0.257 


-0.239 




(0.348) 


(0.326) 


(0.354) 


(0.320) 


(0.372) 


(0.290) 


Pet BA or less 


0.005 


-0.047 


0.051 


-0.023 


0.003 


-0.030 




(0.020) 


(0.017) 


(0.019) 


(0.016) 


(0.019) 


(0.017) 


Pet BA +30 


0.002 


-0.034 


0.017 


-0.013 


-0.005 


-0.028 




(0.013) 


(0.013) 


(0.012) 


(0.012) 


(0.012) 


(0.012) 


Pet fully credentialed 


0.076 


0.056 


0.080 


0.061 


0.099 


0.086 




(0.026) 


(0.028) 


(0.022) 


(0.026) 


(0.021) 


(0.026) 


EL teacher access 


-1.503 


-2.317 


1.193 


-1.784 


-2.142 


0.899 




(1.646) 


(1.085) 


(2.161) 


(1.310) 


(2.010) 


(1.764) 


Percent new students 


-0.022 


0.007 


0.010 


0.005 


0.048 


0.006 




(0.024) 


(0.017) 


(0.023) 


(0.017) 


(0.022) 


(0.016) 


Average GST score 


0.108 


0.109 


0.119 


0.090 


0.153 


0.092 




(0.016) 


(0.013) 


(0.014) 


(0.012) 


(0.013) 


(0.012) 


Observations 


115,188 


120,396 


112,624 


109,983 


100,010 


101,376 



Notes: Standard errors clustered by school are in parentheses. The brackets measure the bilingual effect in standard 
deviations of the dependent variable. R-squareds range from 0.44 to 0.52. All models also contain controls for 
squared teacher experience, age, grade, and dummy variables for missing variables (except bilingual education). 
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Appendix Table Ic - OLS Results for Writing Proficiency, by Grade and Year 



Grade 3 Grade 4 Grade 5 





2003 


2004 


2003 


2004 


2003 


2004 


Bilingual education 


-5.59 


-5.18 


-4.14 


-3.04 


-2.69 


-3.17 




(0.65) 


(0.65) 


(0.66) 


(0.62) 


(0.79) 


(0.85) 


Lagged listen/speak 


0.048 


0.039 


0.034 


0.022 


0.034 


0.015 




(0.003) 


(0.003) 


(0.003) 


(0.003) 


(0.003) 


(0.003) 


Lagged reading 


0.309 


0.328 


0.271 


0.253 


0.250 


0.237 




(0.005) 


(0.005) 


(0.004) 


(0.004) 


(0.005) 


(0.004) 


Lagged writing 


0.339 


0.352 


0.341 


0.377 


0.326 


0.369 




(0.006) 


(0.005) 


(0.005) 


(0.005) 


(0.006) 


(0.005) 


Female 


4.239 


4.022 


5.150 


4.388 


5.264 


3.904 




(0.238) 


(0.222) 


(0.216) 


(0.224) 


(0.228) 


(0.230) 


Title I 


-1.193 


-0.923 


-0.309 


-0.446 


-0.271 


-0.697 




(0.511) 


(0.472) 


(0.461) 


(0.436) 


(0.481) 


(0.475) 


Special education 


-25.13 


-24.71 


-18.97 


-19.33 


-17.79 


-16.22 




(0.715) 


(0.601) 


(0.551) 


(0.519) 


(0.511) 


(0.496) 


Years in current schl 


0.212 


0.324 


0.357 


0.080 


0.295 


0.021 




(0.175) 


(0.144) 


(0.100) 


(0.098) 


(0.085) 


(0.083) 


Language index 


2.070 


1.776 


1.736 


-0.118 


-0.608 


0.933 




(1.278) 


(1.173) 


(1.101) 


(1.043) 


(1.035) 


(1.174) 


Class size 


0.119 


-0.432 


0.020 


-0.030 


0.013 


-0.007 




(0.136) 


(0.109) 


(0.066) 


(0.059) 


(0.044) 


(0.058) 


Percent EL 


-0.016 


0.001 


0.008 


0.005 


0.023 


0.006 




(0.012) 


(0.011) 


(0.010) 


(0.010) 


(0.010) 


(0.011) 


Avg teacher exp 


0.972 


-0.134 


0.995 


0.309 


-0.014 


0.025 




(0.367) 


(0.352) 


(0.356) 


(0.331) 


(0.367) 


(0.329) 


Pet BA or less 


0.002 


-0.052 


0.022 


-0.012 


-0.020 


-0.028 




(0.022) 


(0.019) 


(0.017) 


(0.017) 


(0.020) 


(0.019) 


Pet BA +30 


0.009 


-0.010 


0.028 


0.016 


0.005 


0.010 




(0.014) 


(0.013) 


(0.012) 


(0.013) 


(0.013) 


(0.013) 


Pet fully credentialed 


0.126 


0.126 


0.106 


0.114 


0.110 


0.119 




(0.024) 


(0.028) 


(0.020) 


(0.027) 


(0.022) 


(0.028) 


EL teacher access 


-1.181 


-1.495 


-0.947 


-0.834 


-2.194 


3.149 




(1.867) 


(1.178) 


(2.251) 


(1.524) 


(2.046) 


(1.953) 


Percent new students 


0.027 


0.033 


-0.009 


0.016 


0.042 


0.029 




(0.027) 


(0.019) 


(0.025) 


(0.021) 


(0.022) 


(0.017) 


Average GST score 


0.111 


0.106 


0.112 


0.096 


0.135 


0.078 




(0.017) 


(0.013) 


(0.015) 


(0.012) 


(0.013) 


(0.013) 


Observations 


115,188 


120,396 


112,624 


109,983 


100,010 


101,376 



Notes: Standard errors clustered by school are in parentheses. R-squareds range from 0.49 to 0.53. All models also 
contain controls for squared teacher experience, age, grade, and dummy variables for missing variables (except 
bilingual education). 
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Appendix Table 2 - Instrumental Variables First Stage Results 
Linear Probability Model for Participation in Bilingual Education 
Instruments are Measures of Proposition-227 Induced Changes in School-Level Bilingual Education Availability 



Grade 1 Grade 2 Grade 3 Grade 4 Grade 5 





2003 


2004 


2003 


2004 


2003 


2004 


2003 


2004 


2003 


2004 


Actual change in pet 


0.59238 


0.64013 


0.57623 


0.61179 


0.54749 


0.56398 


0.42764 


0.46106 


0.42764 


0.30427 


bilingual 


(0.02958) 


(0.03020) 


(0.02929) 


(0.03046) 


(0.03009) 


(0.02934) 


(0.02985) 


(0.02998) 


(0.02985) 


(0.02910) 


Mechanical change in pet 


-0.66134 


-0.69743 


-0.65361 


-0.69755 


-0.64044 


-0.65087 


-0.53905 


-0.54340 


-0.53905 


-0.36746 


bilingual 


(0.02726) 


(0.02629) 


(0.02748) 


(0.02651) 


(0.02774) 


(0.02592) 


(0.02828) 


(0.02741) 


(0.02828) 


(0.02695) 


Lagged listening/speaking 


-0.00039 


-0.00045 


-0.00075 


-0.00079 


-0.00017 


-0.00027 


-0.00021 


-0.00013 


-0.00021 


-0.00011 




(0.00004) 


(0.00003) 


(0.00005) 


(0.00004) 


(0.00003) 


(0.00003) 


(0.00003) 


(0.00003) 


(0.00003) 


(0.00002) 


Lagged reading 










-0.00008 


-0.00010 


0.00014 


0.00014 


0.00014 


0.00004 












(0.00005) 


(0.00004) 


(0.00004) 


(0.00003) 


(0.00004) 


(0.00004) 


Lagged writing 










-0.00066 


-0.00071 


-0.00048 


-0.00058 


-0.00048 


-0.00035 












(0.00005) 


(0.00005) 


(0.00005) 


(0.00005) 


(0.00005) 


(0.00004) 


Eemale 


-0.00072 


0.00205 


0.00161 


0.00323 


0.00648 


0.00930 


0.00426 


0.00453 


0.00426 


0.00500 




(0.00180) 


(0.00179) 


(0.00172) 


(0.00168) 


(0.00175) 


(0.00166) 


(0.00162) 


(0.00156) 


(0.00162) 


(0.00146) 


Title I 


-0.00187 


-0.01087 


-0.00533 


-0.01441 


-0.01508 


-0.01777 


-0.01228 


-0.00048 


-0.01228 


0.00471 




(0.00910) 


(0.00933) 


(0.00874) 


(0.00919) 


(0.00932) 


(0.00935) 


(0.00831) 


(0.00869) 


(0.00831) 


(0.00755) 


Special education 


-0.03446 


-0.03198 


-0.04090 


-0.04099 


-0.06241 


-0.05902 


-0.04162 


-0.04703 


-0.04162 


-0.02920 




(0.00527) 


(0.00532) 


(0.00471) 


(0.00468) 


(0.00478) 


(0.00480) 


(0.00409) 


(0.00430) 


(0.00409) 


(0.00335) 


Years in current school 


0.02714 


0.03506 


0.02890 


0.03428 


0.02163 


0.02411 


0.01197 


0.01510 


0.01197 


0.00448 




(0.01057) 


(0.00769) 


(0.00485) 


(0.00397) 


(0.00279) 


(0.00210) 


(0.00173) 


(0.00149) 


(0.00173) 


(0.00122) 


Language index 


-0.02175 


-0.06645 


-0.02752 


-0.07005 


-0.02202 


-0.04504 


-0.02536 


-0.04973 


-0.02536 


-0.05611 




(0.02223) 


(0.02264) 


(0.02187) 


(0.02285) 


(0.02224) 


(0.02188) 


(0.01971) 


(0.02074) 


(0.01971) 


(0.02004) 


Class size 


-0.00688 


-0.00857 


-0.00780 


-0.00626 


-0.00765 


-0.00935 


-0.00460 


-0.00691 


-0.00460 


-0.00749 




(0.00345) 


(0.00242) 


(0.00310) 


(0.00323) 


(0.00298) 


(0.00200) 


(0.00121) 


(0.00131) 


(0.00121) 


(0.00155) 


Percent EL 


0.00080 


0.00073 


0.00065 


0.00031 


0.00052 


-0.00002 


0.00013 


-0.00055 


0.00013 


-0.00041 




(0.00027) 


(0.00029) 


(0.00025) 


(0.00029) 


(0.00026) 


(0.00025) 


(0.00023) 


(0.00022) 


(0.00023) 


(0.00019) 
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Appendix Table 2 (Continued) - Instrumental Variables First Stage Results 
Linear Probability Model for Participation in Bilingual Education 
Instruments are Measures of Proposition-227 Induced Changes in School-Level Bilingual Education Availability 



Grade 1 Grade 2 Grade 3 Grade 4 Grade 5 





2003 


2004 


2003 


2004 


2003 


2004 


2003 


2004 


2003 


2004 


Avg teacher exp 


-0.00586 


0.01886 


-0.00270 


0.01822 


0.00132 


0.01155 


-0.00459 


0.02478 


-0.00459 


0.01443 




(0.00829) 


(0.00942) 


(0.00872) 


(0.00884) 


(0.00826) 


(0.00859) 


(0.00734) 


(0.00702) 


(0.00734) 


(0.00534) 


Pet BA or less 


-0.00121 


-0.00053 


-0.00192 


-0.00009 


-0.00204 


-0.00047 


-0.00158 


0.00026 


-0.00158 


0.00069 




(0.00043) 


(0.00043) 


(0.00042) 


(0.00044) 


(0.00044) 


(0.00041) 


(0.00041) 


(0.00040) 


(0.00041) 


(0.00034) 


Pet BA -1-30 


-0.00031 


-0.00084 


-0.00089 


-0.00028 


-0.00087 


-0.00055 


-0.00066 


-0.00057 


-0.00066 


-0.00036 




(0.00028) 


(0.00028) 


(0.00029) 


(0.00028) 


(0.00028) 


(0.00026) 


(0.00026) 


(0.00025) 


(0.00026) 


(0.00022) 


Pet fully credentialed 


-0.00012 


0.00060 


-0.00001 


0.00060 


0.00012 


0.00101 


0.00077 


0.00115 


0.00077 


0.00075 




(0.00049) 


(0.00074) 


(0.00047) 


(0.00068) 


(0.00045) 


(0.00058) 


(0.00037) 


(0.00053) 


(0.00037) 


(0.00045) 


EL teacher access 


0.03574 


0.02251 


0.02082 


0.05023 


0.04316 


0.01973 


0.03972 


0.02267 


0.03972 


0.01287 




(0.02357) 


(0.02115) 


(0.01700) 


(0.02436) 


(0.02617) 


(0.01356) 


(0.02286) 


(0.01887) 


(0.02286) 


(0.02196) 


Percent new students 


0.00138 


0.00023 


0.00050 


0.00027 


0.00095 


0.00028 


0.00210 


0.00039 


0.00210 


0.00068 




(0.00069) 


(0.00047) 


(0.00062) 


(0.00042) 


(0.00068) 


(0.00039) 


(0.00069) 


(0.00044) 


(0.00069) 


(0.00040) 


Average CST score 


-0.00026 


-0.00046 


-0.00054 


-0.00058 


-0.00036 


-0.00056 


-0.00058 


-0.00051 


-0.00058 


-0.00048 




(0.00039) 


(0.00034) 


(0.00034) 


(0.00033) 


(0.00036) 


(0.00028) 


(0.00032) 


(0.00027) 


(0.00032) 


(0.00025) 


Observations 


114,259 


110,349 


121,637 


119,368 


115,188 


120,396 


112,624 


109,983 


100,010 


101,376 



Notes: Standard errors clustered by school are in parentheses. The results from each column are from a separate regression. See the variables and notes to Table 
3 for a more complete list of additional control variables. 
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Appendix Table 3 - Instrumental Variables First Stage Results 
Linear Probability Model for Participation in Bilingual Education 
Instrument is the Percentage of "Yes" Votes on Proposition 227 



Grade 1 Grade 2 Grade 3 Grade 4 Grade 5 





2003 


2004 


2003 


2004 


2003 


2004 


2003 


2004 


2003 


2004 


Percentage voted "Yes" on 


-0.00411 


-0.00440 


-0.00385 


-0.00401 


-0.00382 


-0.00423 


-0.00286 


-0.00285 


-0.00124 


-0.00159 


Proposition 227 


(0.00052) 


(0.00055) 


(0.00048) 


(0.00050) 


(0.00048) 


(0.00046) 


(0.00043) 


(0.00042) 


(0.00032) 


(0.00035) 


Lagged listening/speaking 


-0.00049 


-0.00054 


-0.00094 


-0.00102 


-0.00015 


-0.00029 


-0.00024 


-0.00012 


-0.00012 


-0.00011 




(0.00004) 


(0.00003) 


(0.00005) 


(0.00005) 


(0.00003) 


(0.00003) 


(0.00003) 


(0.00003) 


(0.00003) 


(0.00003) 


Lagged reading 










0.00004 


-0.00006 


0.00034 


0.00024 


0.00018 


0.00009 












(0.00005) 


(0.00005) 


(0.00005) 


(0.00004) 


(0.00005) 


(0.00004) 


Lagged writing 










-0.00109 


-0.00105 


-0.00078 


-0.00084 


-0.00039 


-0.00043 












(0.00006) 


(0.00006) 


(0.00006) 


(0.00006) 


(0.00004) 


(0.00005) 


Female 


0.00065 


0.00153 


0.00138 


0.00588 


0.00878 


0.01135 


0.00523 


0.00635 


0.00177 


0.00576 




(0.00202) 


(0.00204) 


(0.00192) 


(0.00196) 


(0.00194) 


(0.00180) 


(0.00177) 


(0.00176) 


(0.00153) 


(0.00155) 


Title I 


-0.00447 


-0.01503 


-0.00612 


-0.01223 


-0.01088 


-0.01742 


-0.00565 


0.01511 


-0.00535 


0.01240 




(0.01253) 


(0.01331) 


(0.01185) 


(0.01278) 


(0.01244) 


(0.01265) 


(0.01032) 


(0.00934) 


(0.00916) 


(0.00772) 


Special education 


-0.02591 


-0.02505 


-0.03856 


-0.04224 


-0.07272 


-0.07183 


-0.04609 


-0.05413 


-0.03002 


-0.03159 




(0.00596) 


(0.00606) 


(0.00547) 


(0.00537) 


(0.00533) 


(0.00515) 


(0.00448) 


(0.00471) 


(0.00373) 


(0.00365) 


Years in current school 


0.01592 


0.03172 


0.02571 


0.03967 


0.02335 


0.03032 


0.01616 


0.01927 


0.00537 


0.00781 




(0.01017) 


(0.00685) 


(0.00481) 


(0.00386) 


(0.00301) 


(0.00218) 


(0.00203) 


(0.00171) 


(0.00121) 


(0.00113) 


Language index 


0.13426 


0.09828 


0.13345 


0.09630 


0.13684 


0.10580 


0.11518 


0.07448 


0.05924 


0.02416 




(0.02854) 


(0.02964) 


(0.02673) 


(0.02990) 


(0.02666) 


(0.02743) 


(0.02306) 


(0.02545) 


(0.01881) 


(0.02364) 


Class size 


-0.01501 


-0.00969 


-0.01679 


-0.00842 


-0.01544 


-0.01003 


-0.00421 


-0.00571 


-0.00241 


-0.00308 




(0.00434) 


(0.00343) 


(0.00381) 


(0.00336) 


(0.00343) 


(0.00258) 


(0.00185) 


(0.00173) 


(0.00150) 


(0.00148) 


Percent EL 


0.00172 


0.00215 


0.00171 


0.00168 


0.00151 


0.00107 


0.00102 


0.00047 


0.00055 


0.00028 




(0.00034) 


(0.00037) 


(0.00031) 


(0.00036) 


(0.00032) 


(0.00031) 


(0.00028) 


(0.00027) 


(0.00024) 


(0.00021) 
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Appendix Table 3 (Continued) - Instrumental Variables First Stage Results 
Linear Probability Model for Participation in Bilingual Education 
Instrument is the Percentage of "Yes" Votes on Proposition 227 



Grade 1 Grade 2 Grade 3 Grade 4 Grade 5 





2003 


2004 


2003 


2004 


2003 


2004 


2003 


2004 


2003 


2004 


Avg teacher exp 


-0.00957 


0.02283 


-0.00738 


0.02452 


-0.00081 


0.01853 


0.00089 


0.03147 


-0.00607 


0.01885 




(0.01080) 


(0.00945) 


(0.01027) 


(0.00910) 


(0.01043) 


(0.00890) 


(0.00925) 


(0.00669) 


(0.00782) 


(0.00491) 


Pet BA or less 


-0.00034 


0.00062 


-0.00102 


0.00119 


-0.00124 


0.00068 


-0.00084 


0.00115 


-0.00109 


0.00128 




(0.00056) 


(0.00056) 


(0.00055) 


(0.00055) 


(0.00054) 


(0.00052) 


(0.00049) 


(0.00048) 


(0.00040) 


(0.00038) 


Pet BA +30 


0.00061 


0.00007 


0.00004 


0.00081 


-0.00006 


0.00035 


-0.00001 


0.00021 


-0.00028 


0.00036 




(0.00035) 


(0.00036) 


(0.00035) 


(0.00036) 


(0.00035) 


(0.00033) 


(0.00031) 


(0.00030) 


(0.00027) 


(0.00025) 


Pet fully credentialed 


0.00230 


0.00226 


0.00223 


0.00195 


0.00226 


0.00267 


0.00246 


0.00213 


0.00156 


0.00169 




(0.00059) 


(0.00091) 


(0.00057) 


(0.00087) 


(0.00054) 


(0.00075) 


(0.00044) 


(0.00067) 


(0.00034) 


(0.00051) 


EL teacher access 


0.01970 


0.04313 


0.01158 


0.07424 


0.02761 


0.03403 


0.04508 


0.05493 


0.04529 


0.05385 




(0.02977) 


(0.02731) 


(0.01903) 


(0.02867) 


(0.03279) 


(0.01737) 


(0.02787) 


(0.02233) 


(0.02767) 


(0.02411) 


Percent new students 


0.00072 


0.00075 


-0.00021 


0.00040 


0.00051 


0.00027 


0.00162 


0.00036 


0.00139 


0.00106 




(0.00071) 


(0.00064) 


(0.00063) 


(0.00056) 


(0.00070) 


(0.00051) 


(0.00072) 


(0.00054) 


(0.00059) 


(0.00049) 


Average CST score 


-0.00019 


0.00024 


-0.00043 


0.00013 


-0.00003 


0.00015 


-0.00043 


-0.00019 


-0.00052 


-0.00018 




(0.00050) 


(0.00047) 


(0.00043) 


(0.00044) 


(0.00045) 


(0.00035) 


(0.00038) 


(0.00034) 


(0.00030) 


(0.00028) 


Observations 


111,167 


107,579 


118,427 


116,101 


112,159 


117,152 


109,498 


106,841 


95,178 


96,528 



Notes: Standard errors clustered by school are in parentheses. The results from each column are from a separate regression. See the variables and notes to Table 
3 for a more complete list of additional control variables. 
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Appendix Table 4 - Bilingual Education Interacted with Previous Listening/Speaking Quartile 
Dependent Variable is Reading or Writing Proficiency for Each Grade and Year 

Grade 3 Grade 4 Grade 5 



2003 

Dependent Variable - Reading Proficiency 


2004 


2003 


2004 


2003 


2004 


Bilingual * 1st quartile 


-1.59 


-0.13 


-3.51 


-1.36 


-5.00 


-4.71 




(0.76) 


(0.75) 


(0.78) 


(0.81) 


(1.10) 


(1.20) 


Bilingual * 2nd quartile 


3.48 


6.74 


-0.28 


-0.30 


-3.33 


-1.32 




(0.75) 


(0.78) 


(0.80) 


(0.66) 


(0.97) 


(0.92) 


Bilingual * 3rd quartile 


8.55 


9.53 


3.69 


4.53 


-0.36 


2.02 




(0.95) 


(0.78) 


(0.98) 


(0.80) 


(1.21) 


(0.97) 


Bilingual * 4th quartile 


12.46 


11.22 


6.58 


7.78 


4.14 


5.49 


(0.95) 

Dependent Variable - Writing Proficiency 


(1.07) 


(1.19) 


(0.84) 


(1.92) 


(1.48) 


Bilingual * 1 st quartile 


-10.85 


-8.84 


-8.69 


-6.52 


-6.39 


-6.61 




(0.87) 


(0.84) 


(0.90) 


(0.91) 


(1.17) 


(1.56) 


Bilingual * 2nd quartile 


-3.75 


-1.81 


-1.81 


-1.98 


-1.83 


-2.41 




(0.82) 


(0.82) 


(0.85) 


(0.80) 


(1.03) 


(0.96) 


Bilingual * 3rd quartile 


0.28 


-0.36 


1.11 


-0.06 


0.90 


-0.04 




(0.99) 


(0.80) 


(1.00) 


(0.87) 


(1.09) 


(1.00) 


Bilingual * 4th quartile 


1.85 


-1.50 


0.82 


1.47 


2.49 


0.48 




(0.93) 


(1.18) 


(1.21) 


(0.80) 


(1.35) 


(1.61) 


Observations 


115,188 120,396 


112,624 


109,983 


100,010 


101,376 


Notes: Standard errors are in parentheses. The results from each column and subject are from a separate regression 


(there are a total of 12 regressions) 


. See the variables and notes to Table 3 for a 


more complete list of additional 



control variables. 
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